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Abstract 

Background: Zambia's national HIV testing algorithm specifies use of two rapid blood based antibody assays, 
Determine® HIV-1/2 (Inverness Medical) and if positive then Uni-Gold™ Recombigen HIV-1/2 (Trinity Biotech). Little 
is known about the performance of oral fluid based HIV testing in Zambia. The aims of this study are two-fold: 1) to 
compare the diagnostic accuracy (sensitivity and specificity) under field conditions of the OraQuick® ADVANCE® 
Rapid HIV-1/2 (OraSure Technologies, Inc.) to two blood-based rapid antibody tests currently in use in the Zambia 
National Algorithm, and 2) to perform a cost analysis of large-scale field testing employing the OraQuick®. 

Methods: This was a operational retrospective research of HIV testing and questionnaire data collected in 2010 as 
part of the ZAMSTAR (Zambia South Africa TB and AIDS reduction) study. Randomly sampled individuals in twelve 
communities were tested consecutively with OraQuick® test using oral fluid versus two blood-based rapid HIV tests, 
Determine® and Uni-Gold™. A cost analysis of four algorithms from health systems perspective were performed: 1) 
Determine® and if positive, then Uni-Gold™ (Determine®/Uni-Gold™); based on current algorithm, 2) Determine® 
and if positive, then OraQuick® (Determine®/OraQuick®), 3) OraQuick® and if positive, then Determine® 
(OraQuick®/Determine®), 4) OraQuick® and if positive, then Uni-Gold™ (OraQuick®/Uni-Gold™). This information 
was then used to construct a model using a hypothetical population of 5,000 persons with varying prevalence of 
HIV infection from 1-30%. 

Results: 4,458 participants received both a Determine® and OraQuick® test. The sensitivity and specificity of the 
OraQuick® test were 98.7 (95%CI, 97.5-99.4) and 99.8 (95%CI, 99.6-99.9), respectively when compared to HIV 
positive serostatus. The average unit costs per algorithm were US$3.76, US$4.03, US$7.35, and US$7.67 for 
Determine®/Uni-Gold™, Determine®/OraQuick®, OraQuick®/Determine®, and OraQuick®/Uni-Gold™, respectively, 
for an HIV prevalence of 15%. 

Conclusions: An alternative HIV testing algorithm could include OraQuick® test which had a high sensitivity and 
specificity. The current Determine®/Uni-Gold™ testing algorithm is the least expensive when compared to 
Determine®/OraQuick®, OraQuick®/Determine®, and OraQuick®/Uni-Gold™ in the Zambian setting. From our field 
experience, oral fluid based testing offers many advantages over blood-based testing, especially with self testing on 
the horizon. 
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Background 

The introduction of rapid HIV antibody tests has revolu- 
tionized HIV diagnosis by facilitating the testing of mil- 
lions of people worldwide. The availability of affordable, 
point-of-service HIV testing is especially important in 
low-income, high-HIV-burden countries which lack the 
financial and technological resources to perform more 
sophisticated laboratory-based assays. For these reasons, 
blood based rapid HIV tests have become the standard 
of care and the basis for the national HIV testing algo- 
rithm in many developing countries, including Zambia 
[1-3]. 

Zambia's HIV prevalence of 13.5% [4] makes HIV 
testing a national health priority and the national HIV 
testing algorithm specifies sequential blood-based rapid 
antibody tests: first Determine® HIV- 1/2 Antibody (In- 
verness Medical) is used, which if reactive is followed 
by a different antibody test, Uni-Gold™ Recombigen 
HIV- 1/2 Antibody (Trinity Biotech). If the screening 
and confirmatory tests yield discordant results, then a 
third blood-based rapid antibody test, Bioline® HIV- 1/2 
test (Standard Diagnostic), is performed or blood is 
sent for enzyme linked immunosorbent assay (ELISA) 
testing [1]. 

Despite the benefits of HIV testing, a majority of 
patients living in developing countries are unaware of 
their status. Nine countries, seven of which were in sub- 
Saharan Africa (Democratic Republic of Congo, Kenya, 
Liberia, South Africa, Swaziland, Tanzania, Zambia), 
conducted population-based surveys during 2007 and 
2008 and reported HIV testing rates. Collectively, these 
seven countries account for 32% of the people living 
with HIV globally and 45% of those in sub- Saharan 
Africa. Among the seven countries in sub-Saharan 
Africa, the median HIV testing rates were 30% among 
women and 17% among men. In Zambia, 64.7% of 
women and 79.2% of men reported never having an HIV 
test [5-9]. In Zimbabwe, inconvenience of testing loca- 
tion and testing hours were reported as the main rea- 
sons for individuals not accessing voluntary counseling 
and testing (VCT) services [10]. These data underscore 
the challenges of implementing HIV testing and preven- 
tion that are broadly available and accessible in develop- 
ing countries and furthermore suggest the need for 
innovations in this field. 

As useful as blood-based rapid HIV tests have 
proven to be, it may be possible to further expand 
and improve HIV testing services by employing rapid 
tests using oral fluid. Both oral fluid based and blood 
based rapid HIV tests are performed manually and 
visually read; however, oral fluid-based HIV tests offer 
several advantages over blood based assays: oral fluid 
collection is less invasive as it does not require blood 
draw or finger stick, can be used to self test and is 



less hazardous because oral fluid has a lower trans- 
mission risk of HIV compared to blood [11-13]. Add- 
itionally, in consideration of oral fluid based testing as 
a practical alternative, there are potential cost limita- 
tions. There are few studies that address the cost of 
oral based testing in the field; however, the slow up- 
take of oral HIV testing by resource constrained 
countries may be due to the cost per test, which is 
higher than most blood based tests [14]. Moreover, 
oral fluid based HIV testing performance and sensitiv- 
ity in the developing countries [15-20] and cross re- 
activity with other infections like dengue fever [21] 
are still being published. 

In this study, we performed a field comparison of 
OraQuick® ADVANCE Rapid HIV-1/2 Antibody test 
(OraSure Technologies, Inc.) to two blood-based rapid 
antibody tests currently in use in the Zambian 
National Algorithm for HIV testing. The objectives of 
this study were two-fold: 1) to compare the diagnostic 
accuracy (sensitivity and specificity) under field condi- 
tions of the OraQuick® using oral fluid to two blood- 
based rapid antibody tests currently in use in the 
Zambia National Algorithm, and 2) to perform a cost 
analysis of large-scale field testing employing the 
OraQuick® test. 

Methods 

During 2009 and 2010, the Zambia South Africa TB and 
AIDS reduction study (ZAMSTAR) conducted a TB and 
HIV prevalence survey among 59,705 randomly sampled 
adult residents of sixteen communities in Zambia [22]. 
The ZAMSTAR study was a community randomized 
trial with the main objective of reducing TB and HIV 
prevalence by implementing two community level inter- 
ventions. Within this larger study, we nested a field 
comparison trial of OraQuick® test using oral fluid ver- 
sus two blood-based rapid HIV tests, Determine® and 
Uni-Gold™. Approximately 4,900 OraQuick® tests were 
available for use in the field. 

Study setting 

Of the sixteen ZAMSTAR study communities, twelve 
were conveniently sampled to take part in this field com- 
parison study. Randomly sampled individuals in twelve 
communities in Zambia were tested consecutively from 
April 29, 2010 to August 13, 2010 in their homes for 
HIV using both the oral fluid and blood-based rapid 
assays (Figure 1). All steps in the HIV testing process 
(pre-test counseling, sample collection, performance of 
assays, interpretation of results, presentation of results 
and post-test counseling) were performed in the partici- 
pants' homes by qualified counselors. The twelve 
selected sites were mostly urban communities and one 
rural community. 
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Figure 1 HIV testing algorithm. A If patient self reported Positive HIV status prior to testing then Uni-Gold™ testing was not performed and 
patient was referred to local ART clinic. B Patient told about the "window period" and asked to repeat test in 3 months. C Patient was referred for 
care at local ART clinic. D Patient was referred for further testing via routine VCT centers. 



Study enrolment/selection criteria 

Participation in this field comparison study was open to 
all individuals who met inclusion criteria for the tuber- 
culosis prevalence survey. The inclusion criteria for the 
tuberculosis prevalence survey were: any person living in 
one of the 12 demarcated communities where the study 
was taking place, at least 18 years of age, able to give 
informed consent and able to provide a sputum sample. 

Performing the test 

HIV testing was offered by trained HIV counselors. 
Specific training on how to use OraQuick® test kit was 
offered to 4 team leaders by certified trainers from the 
local OraQuick® manufacturing and distributing com- 
pany. In the field, 48 counselors were trained on how to 
use the OraQuick® test kit by the team leaders. 

A questionnaire was administered and then partici- 
pants were offered OraQuick® test in parallel to 
Determine® test with an explanation that we were per- 
forming a field trial of an HIV test that is not ordinarily 
used in our setting (Figure 1). We explained that the in- 
formation collected would be useful in informing policy 
makers on the performance of the oral based rapid HIV 
test and its potential use in the future. 

All testing was performed according to the manufac- 
turers' instructions [23-25]. The OraQuick® package 



instructions direct the person to place the flat pad above 
the teeth against the outer gum. The person gently 
swabs around the outer gums, both upper and lower, 
one time around, using the flat pad. The person should 
not swab the roof of the mouth, the inside of the cheek 
or tongue. The flat pad is then inserted into the devel- 
oper solution vial and results can be read between 20 
and 40 minutes. Counselors were instructed during their 
training that they may need to wait longer than 40 min- 
utes and that the band may be faint on the OraQuick® 
test if the patient was HIV infected and taking antiretro- 
viral therapy. Participants who reported HIV infection 
prior to testing were not tested using Uni-Gold™ if the 
first test (Determine® or OraQuick®) was positive. 

Data collection and analysis 

HIV test results were entered immediately into personal 
digital assistants (PDA) by the counselor who had per- 
formed the test. Participants with a positive Determine® 
and Unigold™ test were given a referral slip to the local 
health facility to access care. Study data, including the 
questionnaire were conveyed to the main office in Lu- 
saka, where they were downloaded and analyzed using 
Stata v. 11 (StataCorp, College Station, TX, USA). All 
tests which were recorded as being done within testing 
period of April 29, 2010 to August 13, 2010 were 
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included in the analysis. Variables analyzed include base- 
line demographics and rapid test results. Measurement 
of each tests' sensitivity and specificity were compared 
using X 2 test and reported with 95% confidence inter- 
vals. Sensitivity of OraQuick® was measured compared 
to HIV positive serostatus. HIV positive serostatus was 
defined by either having both a positive Determine® and 
Uni-Gold™ test result or a positive Determine® test re- 
sult when the patient self reported a positive HIV seros- 
tatus prior to HIV testing. 

We performed a cost analysis of four algorithms from 
health systems perspective [26]: 1) Determine® and if posi- 
tive, then Uni-Gold™ (Determine®/Uni-Gold™); based 
on current algorithm, 2) Determine® and if positive, then 
OraQuick® (Determine®/OraQuick®), 3) OraQuick® and 
if positive, then Determine® (OraQuick®/Determine®), 4) 
OraQuick® and if positive, then Uni-Gold™ (OraQuick®/ 
Uni-Gold™). Program costs were retrogressively collected 
including personnel for testing and counseling, HIV rapid 
test kits, medical and non-medical equipment and supplies, 
e.g. gloves, sharps container, lancets, and test kits. Assump- 
tions were built into each respective algorithm regarding 
the infrastructure and overhead costs. First assumption was 
that these tests are done under field conditions, where 
counselors perform the test in the clients home. Second as- 
sumption was that operation costs, for example utilities 
(electricity and water), space and maintenance, were the 
same across all tests. Third assumption was that the set-up 
costs were the same for all the tests, e.g., training of HIV 
counselors. Cost of an algorithm was estimated based on 
the cost of screening a sample on the first rapid HIV assay 
and confirmation of a reactive sample on the second rapid 
HIV assay. This information was then used to construct a 
model using a hypothetical population of 5,000 persons 
with varying prevalence of HIV infection from 1-30%. The 
published sensitivity and specificity values [23-25] for each 
test were used to calculate the number of expected positive 
tests for each prevalence category in the model and cost 
per algorithm was reported in terms of average cost per 
case. 

Ethics 

This study received ethical approval from the University 
of Zambia biomedical research ethics committee. 

Results 

4,458 participants received both a Determine® and 
OraQuick® test (Figure 2). 3,682 (82.6%) had both a 
negative OraQuick® and Determine® test result. 721 
(16.2%) participants had both a positive Determine® and 
OraQuick® test result. The sensitivity and specificity of 
the OraQuick® test were 98.7 (95%CI, 97.5-99.4) and 
99.8 (95%CI, 99.6-99.9), respectively when compared to 
HIV positive serostatus (Table 1). 



There were 55 discordant Determine R and OraQuick R 
test results. 40 (73%) were OraQuick® negative and 
Determine® positive and 15 (27%) were OraQuick® 
positive and Determine® negative. A Uni-Gold™ test 
should have been performed when either the 
Determine® or OraQuick® tests result were positive, un- 
less the participant reported a positive HIV status prior 
to testing; however, 31 (56%) Uni-Gold™ test results 
were available for the 55 discordant test results. 7 (13%) 
reported a positive HIV status prior to testing. Of the 31 
Uni-Gold™ test results available for discordant Deter- 
mine® and OraQuick® test results, Uni-Gold™ had a 
higher agreement rate with OraQuick® test results com- 
pared to Determine® test results. 26 (84%) Uni-Gold™ 
and OraQuick® negative test results agreed and 5 (16%) 
Uni-Gold™ and Determine® positive test results agreed. 
Female gender was associated with discordant test 
results, OR = 2.5, 95%CI: 1.2-5.2. Age, community, HIV 
status, and antiretroviral use were not associated with 
discordant test results. 

When the HIV prevalence is 15%, the average unit 
costs per algorithm were US$3.76, US$4.03, US$7.35, 
and US$7.67 for Determine®/Uni-Gold™, Determine®/ 
OraQuick®, OraQuick®/Determine®, and OraQuick®/ 
Uni-Gold™ algorithms, respectively. The cost analysis 
shows that Determine®/Uni-Gold™ was the lowest cost 
option when compared to the other testing algorithms, 
irrespective of the HIV prevalence (Table 2). 

Discussion 

OraQuick® ADVANCE Rapid HIV-1/2 Antibody test 
using oral fluid performed well under field conditions in 
Zambia with a sensitivity of 98.7 (95%CI, 97.5-99.4) and 
specificity of 99.8 (95%CI, 99.6-99.9). The high sensitiv- 
ity and specificity rates in Zambia are comparable to 
Pascoe et al. study evaluating OraQuick® in the field 
and in rural Zimbabwe [18]. A meta-analysis by Pai 
et al, reported a sensitivity of 98.03% [27] for OraQuick® 
testing, which is also comparable to our findings. 

Not only did OraQuick® perform well under field con- 
ditions in Zambia, it also had several notable advantages 
over blood based rapid HIV testing such as elimination 
of discomfort of a finger prick and reduction of blood 
exposure for the health care worker. Anecdotally, many 
non- clinical staff found the kits easy to use as well as to 
train others to use. The participants were curious about 
the new technique, but overall the oral fluid based HIV 
testing was widely accepted and did not seem to confuse 
participants about the transmission of HIV through oral 
secretions; however, a separate study would need to be 
performed to address these issues more clearly. 

Proper storage of rapid HIV test kits is also essential 
to ensure optimal performance. This can be challenging in 
climates with extreme temperatures. The manufacturers' 
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Figure 2 OraQuick and Determine testing. A 138 reported HIV positive status prior to testing. B 4 reported HIV positive status prior to 
testing. C 3 reported HIV positive status prior to testing. 



recommended storage temperatures for the test kits dis- 
cussed in this paper are similar: OraQuick® should be stored 
at 15°-27°C, Uni-Gold™ should be stored at 2°-27°C, 
and Determine® should be stored at 2°-30°C [23-25]. 
While these wide temperature ranges simplify storage 
and transport at ambient temperatures in mild or mod- 
erate climates, they do not preclude the need for air- 
conditioned rooms, refrigerators and transport coolers 
in hot climates. Our review of the literature did not 
find any studies specifically examining the performance 
of OraQuick® when stored above 27°C. 

Although there are several published studies validating 
the OraQuick® test in Africa, there are few studies that 
address the cost of oral based rapid HIV testing in the 
field. There is one study in Ethiopia which performed a 
direct cost comparison between Determine®, Ora- 
Quick®, Capillus® HIV-l/HIV-2 Rapid Test Kit (Trinity 
Biotech) and Uni-Gold™. The authors of this study sug- 
gested implementing oral based tests in Ethiopia's na- 
tional algorithm. Determine®, Capillus®/OraQuick® 
(presence/absence of refrigeration) and Uni-Gold™ 
were recommended as screening, confirmatory and tie- 
breaker tests, respectively [28]. Another study inTanzania 
formulated an alternative cost beneficial confirma- 
tory HIV rapid testing algorithm [29]. They included 



Table 1 Sensitivity and specificity of 


OraQuick 


@ test 




Compared to HIV infected 1 , N =4,391 


Sensitivity (95% CI) 


98.7% 


(97.5%- 


-99.4%) 


Specificity (95% CI) 


99.8% 


(99.6%- 


-99.9%) 


Positive Predictive Value (95%CI) 


99.1% 


(98.1%- 


-99.7%) 


Negative Predictive Value (95%CI) 


99.8% 


(99.5%- 


-99.9%) 



^IV infected as defined by both a positive Determine® and Uni-Gold™ test 
result and/or self reported positive status prior to testing with a positive 
Determine® or OraQuick® test result. 



rapid HIV tests according to WHO recommendation cri- 
teria of cost per test < US$2. Both the Ethiopian and 
Tanzanian studies did not clearly state the costing meth- 
ods or show the cost findings. Our study found that 
Determine @ /Uni-Gold™ testing algorithm is the most 
attractive investment of the four algorithms examined, 
followed by Determine®/OraQuick® algorithm. However, 
the Determine®/OraQuick® algorithm is not ideal practic- 
ally because it loses the main advantage of having 
OraQuick® as a screening test, which is that it can be used 
for self testing. In developed countries, like the United 
States, there are more studies looking at cost for oral 
based rapid HIV testing. One such survey performed at 35 
community clinics in the United States found the mean 
cost per rapid test was US$36.68 for HIV-negative clients 
and US$44.22 for preliminary-positive clients [30]. The dif- 
ference in costs between Zambia and the US is likely 
related to increased operational and human resource costs 
in the US. 

The high sensitivity and specificity of oral fluid based 
HIV testing along with its ease of use make it ideal to 

Table 2 Average unit cost* of 6 algorithms at various HIV 
prevalence rates in a hypothetical population of 5,000 
persons 

Algorithm Average Cost (US$) at different HIV Prevalence 





1% 


5% 


10% 


15% 


20% 


25% 


30% 


Determine®/ 
Uni-Gold™ 


3.28 


3.42 


3.59 


3.76 


3.92 


4.09 


4.26 


Determine®/ 
OraQuick®/ 


3.31 


3.52 


3.77 


4.03 


4.29 


4.55 


4.81 


OraQuick®/ 
Determine® 


7.17 


7.22 


7.29 


7.35 


7.41 


7.48 


7.54 


OraQuick®/ 


7.20 


7.33 


7.50 


7.67 


7.83 


8.00 


8.17 



Uni-Gold™ 

*Unit cost represents the cost screening HIV in each algorithm. 
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use in developing countries. The biggest challenge of in- 
tegrating OraQuick® into testing algorithms is its cost. 
Ideally the increased cost of the OraQuick® test would 
be offset by an increase in the uptake of testing. How- 
ever, our cost analysis was not able to model how many 
tests could be done and how many more HIV diagnoses 
could be made with OraQuick® testing because we 
lacked acceptability data regarding the OraQuick® tests. 
Moreover, OraQuick®s acceptability versus blood-based 
rapid HIV testing in the literature is scant. There is one 
cross sectional study by Choko et al. in Malawi that 
showed very high acceptability and accuracy rates among 
participants using oral supervised self testing [13]. They 
reported that 91.9% of participants opted to self test 
after a brief demonstration and the accuracy was 99.2%. 
Given the many barriers to HIV testing and with self 
testing on the horizon, oral based HIV testing can offer 
an acceptable alternative to blood based testing. 

In addition to lacking acceptability data, this study was 
also limited by partial verification bias; our gold standard 
for the diagnosis of HIV infection was two rapid tests, 
based upon how HIV is diagnosed in Zambia. For dis- 
cordant results, patients did not have a tiebreaker test in 
the field, but instead were referred to the local clinic. 
We did not have access to ELISA or western blot (WB). 
Moreover, antibody based tests like OraQuick®, Deter- 
mine®, and Uni-Gold™ have the disadvantage of miss- 
ing acute HIV infection, which is a significant limitation 
in a high prevalence population. Accuracy may have also 
been affected by difficulties reading the tests under field 
conditions that would be absent in a more controlled la- 
boratory setting. Third, the HIV test results were not 
blinded. All HIV tests were performed and interpreted 
by same person, which could have introduced incorpor- 
ation bias. Knowledge of the first test result may have 
influenced how the second test result was interpreted. 
Lastly, the test sensitivities used for the cost analysis 
were taken from published literature that had used the 
tests among high HIV prevalence populations; however, 
despite this fact the costing trends were apparent, Deter- 
mine® and if positive, then Uni-Gold™ was the least 
expensive of the testing algorithms. 

The results from this study can still be generalized to 
other resource limited settings where HIV screening has 
been rolled out. Although test performance may de- 
crease under field conditions, our study shows that those 
decreases are subtle and are offset by the high seropreva- 
lence of HIV in this setting, thereby increasing the posi- 
tive predictive value of the OraQuick® test in places like 
Zambia. Moreover, a recently published meta-analysis by 
Pai et al.[27] shows that the positive predictive value of 
OraQuick® test in high prevalence populations (>1%) 
was 98.65% versus 88.55% in low prevalence populations 
(<1%). 



The need for increased HIV testing is apparent, but 
the challenges of universal testing carry with it the un- 
certainty of universal treatment. While access to anti- 
retroviral therapy has revolutionized the face of HIV/ 
AIDS in many developing countries like Zambia, the ul- 
timate question of when to treat is still debatable. As 
more studies are needed to answer this question, this 
study adds to the growing body of literature that shows 
that oral-based HIV rapid testing in Africa can perform 
well. 

Conclusions 

An alternative HIV testing algorithm could include Ora- 
Quick® ADVANCE Rapid HIV-1/2 Antibody test which 
had a high sensitivity and specificity. The current Deter- 
mine®/Uni-Gold™ testing algorithm is the least expensive 
when compared to Determine®/OraQuick®, OraQuick®/ 
Determine® and OraQuick® /Uni-Gold™ in the Zambian 
setting. From our field experience, oral fluid based testing 
offers many advantages over blood-based testing, especially 
with self testing on the horizon. 
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